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To investigate the use of measures of belief and systematic observations of 
dassroom behavior to increase consistency between beliefs and teaching practices. 3 
questions were posed: (1) Wl teachers develop a more consistent body of beliefs 
when given empirical evidence of their logical inconsistency? (2) Wl such teachers come 
to behave more or less in accordance with their professed beliefs? (3) Can measures 
of a teacher’s beliefs be used to predict changes in behavior that occur when he is 
exposed to empirical evidence of his personal inconsistency 9 The Teacher Practices 
Inventory, the Personal Beliefs Inventory, and the Teacher Practices Observation 
Record were used to measure beliefs and behavior m terms of agreement or 
disagreement with John Dewey’s phfosophy of experimentalism. Rokeach’s Dogmatism 
Scale was used 1o measure openness to change. Fifty-three teachers were tested 
and observed teaching both before and after an extended mservice program. 
Statistical analysis of the data provided negative answers to al three questions. A 
particular difficulty encountered in this research was the existence of white and Negro 
subgroups in the group of teachers tested. The Negro teachers m this rural area of 
South Florida, apparently anxious to avoid contact with white authority whenever 
possfcle. seemed particularly threatened by the white observers. (SG) 
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This research Investigated the use of measures of belief and system- 
atic observations of classroom behavior to Increase the consistency between 
beliefs and teaching practice. This entailed answering three questions: 

1. Will teachers who are presented empirical evidence of their 
logical Inconsistency develop a more nearly consistent corpus of beliefs? 

2. Will such teachers come to behave more or less In accordance with 
their professed beliefs? 

3. Can measures of a teacher's beliefs be used to predict changes In 
teaching behavior that occur when he Is exposed to empirical evidence of 
his personal Inconsistency? 

The Teacher Practices Inventory (TPI), the Personal Beliefs Inventory 
(FBI), and the Teacher Practices Observation Record (TPOR)* were used to 
measure beliefs and behavior In terms of agreement-disagreement with John 
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Dewey 's philosophy of experimentalise; Rokeach's Dogmatism Scale (D Scale) 
was used to measure openness to change. 



Bob Burton Brown, ‘The Relationship of Experimentalise to Classroom 
Practices" (unpublished Ph.D. dissertation. The University of Wisconsin, 
Hadison, 1962) • 

^Milton Rokeach, The Open and Closed Mind: Investigations into the 
Bature of Belief Systems and Personality Systems (New York: Basic Books, 

Inc., I960). 
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Both before and after an extended In-service program each of 53 teachers 
completed the TPI, PBI, and D Scale and was observed teaching in his own 
classroom by at least one of eight observers using the TPOR. The in-service 
program used the averages of these pretest scores as the basis for a discus- 
sion of the relationship between specific beliefs and behaviors, and the 
teachers, using the TPOR, observed the teaching behavior of several members 
of the group by means of videotape. 
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An index of consistency was created by adjusting the TPI, PBI, and 
TPOR scores to have a common range, and thus using PBI/TPI, TPOR* /PBI*, and 
TPOR' /TPI* as ratios descriptive of individual and group inconsistency. The 
teachers were not urged to adopt any specific belief or behavior, but only 
to develop greater personal consistency regardless of their beliefs and behav- 
ior. In addition to the group discussion of the relation between specific 
beliefs and specific behaviors, in a private conference each teacher discussed 
his scores and his personal inconsistency with the consultant leading the 
in-service program. After the in-service program, the teachers again com- 
pleted the TPI, PBI, and D Scale, and the same team of observers made obser- 
vations using the TPOR. 

Statistical Analysis of the Data 

This research was originally proposed upon the assumption that a sin- 
gle population was being sampled. However, when the pretest scores on the 
TPI, PBI, and D Scale were compared with the scores of a sample of 320 teachers 

^The usual possible range of scores is 40 to 240 for the PBI and TPI 
and 0 to 186 for the TPOR. To equalize the ranges, the following corrections 
were made: PBI - 40 « PBI* and TPI - 40 * TPI*; TPOR x 1.075 « TPOR*. This 

gives the corrected scores a possible range, of 0 to 200; 
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from five states reported by Vickery and Brown, ^ It was discovered that the 
present sample was significantly more dogmatic. Separating the scores of 
Negro and white teachers showed that the latter group was not significantly 
different from the national sample on the D Scale, but the Negro subgroup was. 
In addition, the Negro teachers were also significantly different from the 
white subgroup on the D* Scale, TPI, and TFOK. 

Table I summarizes this data. This finding necessitated the analysis 
of the data In terms of two subgroups Instead of one. The white subgroup 
was composed of 14 teachers who had an average age of 40.5 years with a 
standard deviation of 15.3 years: the 39 Negro teachers had an average age 
of 37.0 years with a standard deviation of 10.2 years. 

Score changes • The only significant score change for either subgroup 
was a decrease for the Negro teachers on the 0 Scale. Although all other 
changes were nonsignificant, comparisons of posttest means for the subgroups 
showed that the sggnlficant pretest difference on the TPI had disappeared and 
that the statistical significance of the difference on the D Scale and the 
TPQR had Increased to the .01 level of confidence. Tables II and III summa- 
rize this analysis. 

The change In TPOR scores Introduced a problem of observer reliability 
which limited the amount of useful Information which a simple comparison of 
scores could give. To account for the change, five different multiple 

*Tom Rusk Vickery and Bob Burton Brown, “Descriptive Profiles of 
Beliefs of Teachers" (paper read at the Annual Meeting of the American 
Educational Research Association, New York, February 16, 1967). 
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TABLE I 

COMPARISONS OF PRETEST MEAN SCORES OF SOUTH FLORIDA 
GROUPS AND NATIONAL SAMPLE 



South Florida Sample Nat'l 
(1) (2) (3) (4) 

Total Negro White Sample 8 1 & 4 2 & 4 3 & 4 2 & 3 



PBI Mean 
S.D. 

TPI Mean 
S.D. 

D Scale Mean 
S.D. 

TPOR Mean 
S.D. 



141.4 

17.5 


140.4 

15.6 


168.1 

18.2 


164.9 

16.8 


145.7 

25.2 


140.4 

31.9 




79.2 

25.8 



144.4 


142.6 


22.4 


18.1 


177.1 


168.5 


19.5 


21.5 


160.4 


158.4 


22.2 


17.5 


96.4 




24.6 





-0.44 -0.83 
-0.13 -1.22 
-3.53 C -3.45 C 



0.30 -0.74 
1.60 -2 . 34 b 
0.34 -2 . 17 b 



0 

The national sample data used here was taken from the research 
reported by Vickery and Brown, ££. cit . 

b p <.05 

c p <.01 
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TABLE II 

t- VALUES FOR PAIRED DIFFERENCES IN PRETEST 
AND POSTTEST MEANS FOR THE SUBGOUPRS 



Instrument 

Group 


Pretest 
Mean S.D. 


Posttest 
Mean S.D. 


d 


t 


PBI 

Negro 

White 


140.4 

144.4 


15.6 

22.4 


138.7 

143.6 


12. 1 
18.5 


- 1.7 

- 0.8 


- 0.71 

- 0.24 


TP I 

Negro 

White 


164.9 
177. 1 


16.8 

19.5 


168.7 

176.9 


16.4 

23.9 


3.8 

- 0.1 


1.32 

- 0.05 


D Scale 
Negro 
White 


140.4 

160.4 


31.9 

22.2 


130.3 

155.7 


25.4 

20.1 


- 10.1 

- 4.7 


- 2 . 32 a 
- 1.06 


TPOR 

Negro 

White 


79.2 

96.4 


25.8 

24.6 


77.8 

105.8 


29.4 

28.4 


- 1.4 

9.4 


- 0.36 

1.17 


a p <.05 
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COMPARISON OF POSTTEST MEANS FOR 
SOUTH FLORIDA SUBGROUPS 






Instrument 


Negro 

Mean S.D. 


White 

Mean S.D. 


d 


t 


PBI 

TPI 

D Scale 
TPOR 


138.7 

168.7 
130.3 

77.8 


12.1 

16.4 

25.4 

29.4 


143.6 
176.9 

155.7 

105.8 


18.5 

23.9 

20.1 

28.4 


4.9 

8.2 

25.4 

28.0 


1.12 

1.44 

3 . 40 a 

3 . 10 a 
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regression models were used to try to predict the change in TPOR scores. The 
initial model had only six variables— the averages of the pretest and posttest 
scores on the PBI, TPI, and D Scale and the differences in each case between 
the first and second administrations of the same instruments. These variables 
were found to contribute 7 per cent of the information necessary to predict 
the variation in TPOR scores. The second linear regression added the observers 
as dummy variables, and R Increased to 34 per cent. Despite the fact that 
the addition of the observers added 27 per cent to the information contributed 
by the equation, the F value was still nonsignificant. 

The last three models were quadratic equations, allowing for a curvi- 
linear relationship. The third model, with thirty-five variables, excluded 
the observers, using instead model one plus the average of the two TPOR scores, 

and the squares and interactions of these variables. Although this increased 
2 

R to 60 per cent, the F value decreased. Model four added the race of the 

observee, which added 1 per cent. Model five added the observers to model 

2 

four, which produced an R of 84 per cent and pushed F to 2.11, which is 
barely significant at the .05 level of confidence. These regressions are 
summarized in Table IV. 

The fact that it took a forty-three variable model, which accounted 
for 84 per cent of the variation in the differences between first and second 
scorings of the TPOR, to produce a statistically significant F ratio points 
up the failure to identify any highly significant variables in the situation. 
However, the only two F ratios of substantial size were associated with 
models two and five, the only two equations which included the observers. 
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TABLE IV 

MULTIPLE REGRESSION EQUATIONS USED TO 
PREDICT CHANGES IN TPOR SCORES 



Model 


Number of 
Variables 


Regression 

Type 


R 2 


F a 


df 

mi 


i&2 


F b 


1 


6 


linear 


0.07 


0.72 


6 


54 




2 


13 


linear 


0.34 


1.90 


13 


47 


2.22 c 


3 


35 


quadratic 


0.60 


1.06 


35 


25 


).71 


4 


36 


quadratic 


0.61 


1.04 


36 


24 


0.80 


5 


43 


quadratic 


0.84 


2.11 c 


43 


17 


3.58 c 



a Thi8 is the F ratio of the mean squares for the regression and 
for error within a given model. 

This is the F ratio resulting from a test of significance of 
the It of two multiple regression equations. Each value in this column 
represents the difference in R for the model in that row and the one 
immediately above it. Thus models two and five made statistically 
significant contributions over models one and four, respectively. For 
a discussion of this test, see J. P. Guilford, Fundamental Statistics 
in Psychology and Education (fourth edition; New Yorks McGraw-Hill 
Book Company, 1965), p. 403. 

c p<.05 
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And in both cases the inclusion of the observers increased R to the point 
that model two made a significant increase in information over model one and 
model five over model four. Table IV also Includes the F values for the 
difference between R of succeeding equations. The two significant increases 
imply that the )lock of dummy observer variables was the principal contribu- 
tor identified. A comparison of the R^ of model three with model one yields 
an F of 1.12 y the nonsignificance of which substantiates the Importance of 
the observer variables. 

Ratio changes. Inasmuch as there were no significant changes in any 
of the component scores which form the ratios , the lack of a significant 
change in any ratio mean was no surprise. Only in the case of the white 
subgroup's TPOR'/TPI' ratio was there increased consistency. In every other 
instance the posttest ratio mean was further removed from 1.000 than the 
pretest ratio mean. However, in no instance did a group become significantly 
less consistent. Table V summarizes the results of this analysis. 

Although there were no significant changes within a subgroup on any 
ratio, there were such changes between subgroups. The pretest mean ratios 
for the subgroups were not significantly different; however, Table VI shows 
that at the end of the in-service program the Negro and white teachers 
differed significantly on the mean TPOR'/PBI' and TPOR'/TPI' ratios. The 
TPOR means were significantly different at the .05 level of confidence 
before the in-service program, and this difference increased substantially 
(to the .01 level of confidence) on the posttest. Both the TPOR'/PBI* 
and the TPOR'/TPI' ratios reflect this change. The reservations about the 
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TABLE V 

t-VALUES FOR PAIRED DIFFERENCE OF PRETEST AND 
POSTTEST RATIOS FOR SUBGROUPS 



Instruments 

Group 


Mean 

Pretest 


Ratios 

Posttest 


d 


t 


PBI/TPI 


Negro 


0.858 


0.830 


-0.028 


-1.44 


White 


0.817 


0.814 


-0.003 


-0.11 


TPOR'/PBI* 


Negro 


0.870 


0.861 


-0.009 


-0.19 


White 


1.047 


1.119 


0.072 


0.66 


TPOR’/TPI* 


Negro 


0.690 


0.657 


-0.033 


-0.77 


White 


0.767 


0.844 


0.077 


1.23 
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TABLE VI 

COMPARISON OF RATIO MEANS OF 
NEGRO AND WHITE SUBGROUPS 



Instilments 

Order 


Negro 

Mean 


S.D. 


White 

Mean 


S.D. 


t 


PBI/TPI 

Pretest 


0.585 


0.111 


0.817 


0.102 


-1.13 


Posttest 


0.830 


0.104 


0.814 


0.082 


-0.58 


TPOR'/PBI* 


Pretest 


0.870 


0.314 


1.047 


0.405 


i.49 


Posttest 


0.861 


0.334 


1.119 


0.309 


2.62* 


TPOR'/TPI* 


Pretest 


0.690 


0.221 


0.767 


0.210 


1.16 


Posttest 


0.657 


0.244 


0.844 


0.235 


2.53® 



a p<.05 
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difficulty of obtaining reliable TPOR scores have already been discussed; 
however, it should be noted that these reservations apply also to ratios 
which utilized the TPOR scores. 

The Negro teachers were significantly more dogmatic than the white 
teachers at the beginning of the program, and they became significantly more 
dogmatic during the program, preserving the significant difference between 
the two subgroups on the pretest. However, the regression models did not 
show the D Scale to be a significant information contributor to the change 
in TPOR scores. For the Negro subgroup there was a significant (p<.01) 
negative correlation (r ■ -.52) between the initial D Scale score and any 
change on the D Scale during the in-service program, which would imply that 
the more dogmatic a Negro teacher was at the beginning of the in-service 
program, the greater his increase in dogmatism. There was no such signifi- 
cant correlation for the white subgroup. 

Personal Threat and Dogmatism 

Once the in-service program began, it became obvious to the observers 
and the consultant that many of the Negro teachers were feeling extremely 
threatened by the whole enterprise. Investigation revealed that the schools 
of the county were to be integrated the following year, and many Negroes 
interpreted the sudden interest of white educators in them and in their 
beliefs and teaching practices as an evaluation process designed to deter- 
mine which Negro teachers to transfer to formerly white schools and which 
to replace with "superior" white teachers. This becomes more credible when 
one recognizes that segregation in this rural, south Florida county was so 
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complete that only white people lived in the only town of any size, and many 
Negro children were bused across the county— past several white schools— to 
an appropriate Negro school! The 14 white participants in the in-service 
program were specially selected representatives of the white schools which 
were soon to be Integrated; they were there solely to smooth the way to 
peaceful integration. 

The team of observers— all of idiom were white— reported that they were 
met with hostility in many Negro classrooms. In order that they might be 
as well-prepared as they wished v the teachers were told when they would be 
observed at least a day in advance. In one instance the observer waited 
almost two hours in the classroom with the pupils while the teacher made 
herself unavailable. In another instance a teacher refused to make an 
appointment for the following day because she planned to be ill. In several 
Instances the tea c he r would te ach in the presence of the observer only after 
personal assurances from the observer that the observation was not part of 
a county-wide evaluation of Negro teachers. 

Despite the fact that many of these people perceived the in-service 
program and/or the data collection procedures of this research as a direct 
personal threat related to the integration of the schools* it is impossible 
to know the exact effect that this had upon the subjects of this study. It 
is possible that generations of segregation, with the cultural and financial 
pover t y and limited education which accompanied it, have produced a Negro 
subculture in this area that is significantly more dogmatic than the dominant 
white culture. It is also possible that generations of unequal treatment by 
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society has created a Negro subculture that has learned to exist by avoiding 
contact with white authority whenever possible and that becomes very 
threatened when such contact is forced upon it. 

Unfortunately there is no way to know what the findings of this research 
would have been if the threat of integration had not been there and/or if the 
consultant and observers had been Negroes. Nor is there a way to know if 
these same Negro teachers would have been more open to change in another 
situation. 

However, there was a second kind of personal threat which both the 
Negro and white teachers were exposed to: the experience of being confronted 

with evidence which showed them to be inconsistent and to be guilty of 
teaching behavior of which they did not approve. The in-service program had 
this as its function, to see if teachers could be stimulated to behave as 
they believed. However, the Negro subgroups, already threatened by impending 
integration and possible loss of jobs and already significantly more closed 
to change than the white teachers, reacted to this new trauma by resisting 
a perception of themselves which they could not assimilate and which they 
ultimately rejeetdd. They became even more dogmatic. 

The white teachers, seeing that they were as inconsistent as the Negro 
teachers, reacted by widening the TPOR behavioral gap between themselves and 
the Negro teachers from 17.2 points on the pretest to 28.0 points on the 
posttest. As Tables I and III show, the pretest difference was significant 
at the .05 level of confidence, but the posttest level was .01. This was 
possible because they were not immobilized by their dogmatism. 
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Conclusions 

All three research questions originally proposed received negative 
answers on the basis of this data* The only significant change was in 
dogmatism, and there were no significant increases or decreases in consistency* 
Mo significant predictors of change in teaching behavior were found* Although 
the division of an already small sample into two smaller subsamples and the 
association of the research with Impending integration certainly limit the 
generalizability of the findings, certain trends in the data may be pointed 
out, if only tentatively. 

Empirical evidence of personal inconsistency seemed to promote greater 
consistency only in- those Instances in which the inconsistency was 
associated with some very personal threat that could be eliminated by 
changed beliefs and behavior, especially the latter* The white teachers who 
had come to help the Negro teachers were compared with them, and this 
anxiety-producing similarity stimulated a substantial change in behavior away 
from the Negro subgroup* The latter subgroup had no apparent way to remove 
the tension they felt. 

The reaction of teachers to empirical evidence of personal inconsistency 
seemed to be a function of their openness to change. If they were not 
immobilized by dogmatism, if the knowledge of inconsistency posed a personal 
threat, they seemed to change at the points of greatest personal tension* How- 
ever, people who were not open to change seemed to retreat from the evidence 
and draw themselves into a shell of increased resistance to change of any sort. 



